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Abstract 

We consider gradient systems with an increasing potential that depends on 
a scalar parameter. As the parameter is varied, critical points of the potential 
can be eliminated or created through saddle-node bifurcations causing the 
system to transit from one stable equilibrium located at a (local) minimum 
point of the potential to another minimum along the heteroclinic connections. 
These transitions can be represented by a graph. We show that any admissible 
graph has a realization in the class of two dimensional gradient flows. The 
relevance of this result is discussed in the context of genesis of hysteresis 
phenomena. The Preisach hysteresis model is considered as an example. 


1 Introduction 

Hysteresis is a complex type of relationship between variables. The term was first 
introduced by James Ewing in his studies of properties of magnetic materials and 
may be translated as “to lag behind” from ancient Greek. The key feature of 
hysteresis is the dependence of the value of an output variable on some past values 
of the input variable, that is a type of memory. This dependence is mediated by 
the internal state that changes in response to variations of the input and is affected 
by the history of these variations (hence, to predict future outputs, one needs to 
know either the current internal state or the history of input variations). The term 
hysteresis is associated with a specific type of memory that can be characterized 
as persistent memory (as opposed to fading or scale-dependent memory such as 
described by the convolution integrals, delayed arguments, etc.). A mathematical 
idealization that is used to describe hysteresis is a so-called rate-independent input- 
output operator, that is an operator that commutes with the group of all increasing 
transformations of time T|. A consequence of the rate-independence (in case of 
scalar-valued inputs) is that only certain (local) maximum and minimum values of 
the input achieved in the past can affect the future. 

1 The author was supported by National Science Foundation grant DMS-1413223. 
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Hysteresis occurs in many phenomena, for example, it is encountered in mag¬ 
netism m, plasticity UGa, friction ©0. mechanical damage and fatigue [TO], 
constitutive relationships of “smart” materials (shape memory alloys, piezo-electric 
and magnetostrictive materials ©©), porous media filtration mm3!, phase tran¬ 
sitions nuiT7] and engineering (thermostat, non-ideal switch and backlash nonlin¬ 
earity are usual examples H5ESI). The simplest example of hysteresis is probably 
a bi-stabile system (in dynamical systems theory the two terms, bi-stability and 
hysteresis, are sometimes used almost as synonyms). Suppose that at an equilib¬ 
rium the system minimizes some potential function (such as Helmholtz free energy 
density in Landau’s theory of phase transitions and critical phenomena BSD- Fig. CD 
shows a double well potential perturbed by a linear term. Let us consider the co¬ 
efficient u of this term as a control parameter (input) of the system. Suppose the 
system occupies the state corresponding to the right minimum point of the poten¬ 
tial at some time. As u varies, the profile of the potential changes, and the right 
minimum can be eliminated, in which case the system has to make a transition to 
the other (remaining) minimum point, see Fig. [I] A similar transition from the 
left to the right minimum point occurs at a different threshold value of the control 
parameter u, at which the left minimum point gets eliminated. Thus, we observe 
co-existence of two equilibrium states for some interval [u_, u+] of the input values 
with transitions from one state to the other happening when u reaches the value 
m_ and the opposite transitions happening at the other end u + of the bi-stability 
interval. This is exactly a description of the simple hysteretic switch known as the 
non-ideal two-threshold relay, see Fig. [2] (left). 

It is important to note that the applicability of the bi-stable relay model hinges 
on certain assumptions about characteristic time scales of several processes. In sta¬ 
tistical physics, the global minimum of the energy potential corresponds to a persis¬ 
tent stable equilibrium, while local (relative) minima are interpreted as metastable 
states that can persist for limited characteristic time only before decaying eventually 
to the global minimum due to thermal fluctuations. The non-ideal relay model as¬ 
sumes that the characteristic time that passes between the transitions of the system 
from one state to another due to variations of the input u is much shorter than the 
characteristic time that the system would spend in a metastable state before ther¬ 
mal fluctuations would guide it to the absolute minimum. On the other hand, the 
process of relaxation to a new state after the system has left some metastable state 
(that has been eliminated by a variation of the input) is assumed to be much faster 
than the input process, that is transitions are almost instantaneous compared to the 
time that the system spends in the stable and metastable states. Let us also remark 
that a mechanisms of switching between states of a bi-stable system is not neces¬ 
sarily related to minimization of some functional. Two further important examples 
of multi-stable systems are presented by slow-fast systems [19j and systems with 
feedback (such as, for instance, in Weiss mean field model of magnetization [20]). 

Fig- CD presents the simple hysteresis effect. More complex hysteresis phenom¬ 
ena (that have been well known in magnetism, plasticity and sorption for decades) 
are described by input-output diagrams with a continual family of ascending and 
descending curves and nested hysteresis loops, see Fig. [2] (right). A schematic input- 
output diagram on the right panel of Fig. [2] may represent a complex dependence of 
magnetization of a ferromagnetic material on the applied magnetic field, or a stress- 
strain relationship in an elasto-plastic body, or moisture content of a porous medium 
vs applied pressure, etc. Various models of complex hysteresis relationships have 
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been proposed and used by physicists and engineers. A few most prominent models 
include the Preisach model of magnetic materials, the Prandtl-Ishlinskii model of 
plasticity and friction and the Ising spin-interaction model of phase transitions in 
statistical physics (that have been also adapted to model sorption hysteresis [2TH24] ; 
damage accumulation [25] : constitutive laws of “smart” materials; hysteresis in eco¬ 
nomics [25U2B] . social dynamics and population biology (2SH31]; see [331 El] f° r 
further examples). Mathematical tools that have been developed in the area of 
modeling hysteresis phenomena and systems with hysteretic components are di¬ 
verse and include the method of hysteresis operators E3 ■ differential inclusions [ 36 ], 
variational inequalities E3, variational approach based on T-convergence EH] and 
switched systems EE- 

The above mentioned models of hysteresis are phenomenological and either 
describe hysteresis effects on a macroscopic level (for example, the Preisach and 
Prandtl-Ishlinskii models) or use an extremely simplified microscopic model of re¬ 
ality (such as in the Ising model). Derivation of macroscopic models of hysteresis 
from first principles, or microscopic physics, remains a daunting challenge [33| . One 
idea is that in a complex energy landscape with a large number of metastable states, 
transitions between these states caused by variation of the control parameter (such 
as shown in Fig. |T] for a simple double well potential) may result in a complex 
hysteresis relationship between macroscopic variables. Indeed, this idea has been 
entertained by researchers in hysteretic systems for a period of time. However, to 
the best of our knowledge, no precise results validating this idea have been obtained 
so far. A question that may be asked in this relation is whether any given “map” 
of transitions between metastables states can be realized by a gradient system that 
transits from one equilibrium to another in response two variations of the input 
parameter. 

In this paper, we give a positive answer to this question under the assumptions 
that (a) the hysteretic system has a discrete set of states (and hence can be described 
as a directed graph); and, (b) the input of the system is a scalar variable. It turns out 
that any system of this type can be realized by a gradient system with two degrees 
of freedom. We do not impose restrictions on the functional of the gradient system. 
Whether it is possible to use functionals from a certain class may be a subject of 
future work. Another question which goes beyond the scope of the present paper is 
whether continuous hysteresis relationships could be thought of as some continuous 
limit of the gradient systems. 

The paper is organized as follows. In the next section we discuss the setting 
of the problem and present the main result. In Section 3, a graph describing the 
dynamics of the discrete Preisach nonlinearity is considered as an example. Section 
4 contains the proofs. We use an explicit construction for the functional of the 
gradient system in order to obtain a realization of any given graph that encodes 
transitions between the states of a hysteretic system. Finally, a brief discussion of 
multi-scale dynamics and their adiabatic limit is presented in the Apprndix. 


2 Main result 

The problem can be formally stated as follows. Consider a directed graph F with 
the following properties. 
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indicates the state of the system. When u increases, the right minimum collides with 
the local maximum of the potential and disappears. As a result of this bifurcation, 
the black point that was sitting in the right minimum (left panel) makes a transition 
to the remaining minimum (right panel). 


(i) The set S of all vertices is a union of n + 1 non-empty disjoint subsets: 

s = u? =0 s i; Si n Sj = 9,i^ n s t ± 0. 

(ii) For every 1 < i < n — 1 and every vertex s G Si there are exactly two edges 
ss' and ss" emanating from s. The end point s' of one edge belongs to Si- 1 , the 
end point s" of the other edge belongs to S, + i. Furthermore, for every s G So U S n 
there is exactly one edge ss' emanating from s; the end point s' of this edge belongs 
to Si if s G So and to S n -\ if s G S n . 

Graphs with these two properties will be called admissible. 

Dynamics on an admissible graph T is defined as follows. It is assumed that the 
input u of the hysteretic system takes values from a finite set 

U = {u°,..., u n }, u° < u 1 < ... < u n . 

Any input sequence Ut should satisfy Ut G U and either ut = u l ~ 1 or u t — u l 
or u t = id -1 if u t = u % for all t. Vertices s from the set Si represent possible 
states of the hysteretic system at any moment when it t = u l . Edges of the graph 
define transitions between the states induced by the input sequence. If ut- 1 = u l , 
Ut = u l+cr with a = ±1, and St-i = s' € Si, then St = s" where s's" is a unique 
directed edge with s" G Si +a . 

Now, let us consider the gradient system 

x = -V x V(x,u) (1) 

with x G u G R. Question is whether for any given admissible graph T it 
is possible to construct a functional V(x,u) such that the anti-gradient dynamics 
defined by V agrees with the dynamics on T. A few more definitions are in or¬ 
der to formalize this question. We will assume everywhere that V is continuously 
differentiable in x and continuous with respect to x,u. 

Suppose that the functional V{-,u) has an isolated critical point x*(u) for each 
u G [u_, it+] and that this point continuously depends on u. Suppose that x*(u) is a 
point of local minimum for u G [u_, u+), which undergoes a saddle-node bifurcation 
at u = u + . That is, a7*(u + ) is a saddle-node point of the gradient field — V X V (•; u*) 
and a ball \x — x*(u + )\ < p does not contain critical points of V(-,u) for some 
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Figure 2: Left: Two-state non-ideal relay switches from state r = 0 to state r = 1 
when the input u exceeds the threshold value u+ and from state r = 1 to state 
r = 0 when u goes below the threshold value u- that satisfies u- < u+. Right: 
Hysteresis curves typical of complex hysteresis relationship between input u and 
output p such as in the Preisach model. The picture corresponds to an oscillating 
input with decreasing amplitude that becomes periodic after a few oscillations. 


interval u G [u+,u+ + <5). Assume that x**(u+) is an isolated local minimum point 
of V(-,u+). We say that the local minimum point x*(u-) of V(-,u-) connects to 
the local minimum point x**(u+) of V (•, u+) if the unstable manifold of the saddle- 
node equilibrium point x*(u+) of the gradient field — V x V(-,u + ) belongs to the 
basin of attraction of the stable equilibrium x**(u+) of this field. 

If u changes adiabatically (very slowly) from u— to u+ and gradient system 
ijljl is at the equilibrium x*(u—) for u = u_, then this system will remain at the 
equilibrium x*(u) until the adiabatic input u crosses the value u = u+. At this 
point, the equilibrium x*(u) will disappear in the saddle-node bifurcation and the 
system will switch to another equilibrium x**(u+) along the unstable manifold of 
x*(u. (-). Some brief discussion of multi-scale systems that lead to equation dTJ in 
the adiabatic limit is presented in the Appendix. 

Similarly to the above definition, we say that a local minimum point x*(u+) of 
V(-,u+) connects to a local minimum point x**(u-) of V(-,u_) if x*(u ) undergoes 
the saddle node-bifurcation at u = U- and the unstable manifold of x*(u-) belongs 
to the basin of attraction of the stable equilibrium x**(u-) of the gradient flow. 

We will also say that x*{u-) and x*(u+) are reversibly connected if x*(u) is an 
isolated local minimum point of V(-,u) for all u G [u_,u+] and x*(u) continuously 
depends on u. For such equilibrium points, the gradient system remains at the 
equilibrium state x*(u) at all times as long as the input is varied adiabatically 
within the range [u- , u+] and provided that the system was at this state initially. 

Let us extend the above definitions to the case of several transitions between 
the equilibrium points points. Suppose that a local minimum point x* k _ x of the 
functional V(-,Vk—i) connects to the local minimum point x k of the functional 
V (•, Vk) for every k = 1, where U- = Vo < t>i < • • • < Vg = u+ is a partition 

of the interval [it_, u+\. Then we say that ajg connects to x\. Similarly, we say that 
x\ connects to ajg if x* k connects to x* k _ ± for every k = 
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We call a gradient system x = — V x V(x, it), x G l d a realization of an admissible 
graph r if 

(i) The functional V(-,u) is radially increasing for each u G [uo,u n ]: 


lim V ( x , u ) = oo. 

1031 —>-00 


(ii) The set of the points of local minimum of the functional V is in one- 
to-one correspondence x* = Xi(s) with the subset Si 9 s of the vertices of T for 
every i = 0,..., n. 

(iii) A local minimum point x* of the functional V(-,Ui) connects to a local 
minimum point x** of the functional V(-,itj+, T ) with a = ±1 iff there is an edge 
s's" of T such that x* = Xj(s'), x** = X i+a (s"). 

Adiabatic variation of the input u of the gradient system over the interval [it, it"] 
results in transitions from one to another equilibrium state. If we restrict observa¬ 
tions to the instants when the input value belongs to the finite set U = {u°, ..., it 71 }, 
then according to the above definition, the dynamics of transitions between the 
equilibrium states of the gradient system realizing the graph T will be identical to 
dynamics on the graph T. 

The following statement is the main result of this paper. 

Theorem 2.1 There is a planar realization for every admissible graph T. 

A constructive proof of this theorem is presented in Section [4] 

3 Example: Realization of the Preisach hysteresis 
model 

Fig. [U defines one of the simplest hysteresis operators called the non-ideal relay. The 
state of the relay corresponding to the right minimum of the double well potential 
is denoted by 0, the other state corresponding to the left minimum is denoted by 
1. The relay switches from state 0 to state 1 when the input u = Ut exceeds a 
threshold value u + and from state 1 to state 0 when the input becomes smaller 
than a different threshold value U- which satisfies it_ < it+. Therefore [rt_,u+] is 
a bi-stability interval for the relay, see Fig. [2] (left). For a given input sequence ut 
we will denote the time series of the varying state of the non-ideal relay by 


Tt 'R'U — ,U_j_ [^t] • 


The finite (discretized) Preisach model is a superposition of N(N + l)/2 relays 
that have a common input u = Ut which often is also discretized. The relays have 
different thresholds. The output of the model is defined by the formula 


N 



where the thresholds of the relays, (a^,/3y), typically sit on a lattice of step e 
in the half-plane /3 > a of a plane (a, /?) and form a mesh in an isosceles right 
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Figure 3: Left: (a,/3) plane for the discrete Preisach model with N(N + l)/2 = 15 
relays (N = 5). Each black point represents a non-ideal relay with thresholds a,/3. 
The staircase line L represents a state of the model. Those relay below this line are 
in state 1, the relays above this line are in state 0. Right: Graph T describing the 
discrete Preisach model for N = 4. The graph has 2 N = 16 nodes corresponding to 
16 possible staircase states of the model, each encoded by a four-tuple of zeros and 
ones. The sets Sq, Si, S 2 , S 3 , S 4 consist of 1,4, 6,4,1 nodes, respectively. 


triangle; and, the input takes values {u°,... ,u N } at the nodes situated between 
the threshold values, see Fig. [3] (left). States of the model can be identified with 
the polylines L that connect the vertex O at right angle of the triangle with its 
hypothenuse on the line a = /3, see Fig. [3] (left). Each polyline has N links that 
have length e and are either horizontal or vertical. Therefore a state can be encoded 
by, and identified with, an TV-tuple (ai,..., ajv) where each a% equals either 0 or 1 
and we write 0 for a vertical link and 1 for a horizontal link; a\ defines the direction 
(vertical or horizontal) for the link starting at the point O , ci 2 correspond to the 
next link and so on. The set 5* corresponding to the input value u l consists of the 
states L that have exactly i entries 1. 

A detailed description of the Preisach model can be found, for example, in 
H2JI1MSI. In particular, transitions between the states are defined by simple 
rules. Adapting these rules for the discretized model considered here, we obtain the 
following description of transitions between the states. If the system is at a state 
(ai,..., ajv) £ Si and the input changes from it* to it* +1 , then the system transits 
to the state ( 61 ,..., 6 jv) defined by the formulas 

bk = 1 if a*, = 0 and either k = N or <ik+\ = • • • = a« = 1; bj = a,j for j 7 ^ k. 

That is, the last 0 in the ./V-tuple (m,..., ajv) changes to 1. Similarly, when the 
input changes from it* to it* -1 , the system transits from a state (ai,..., ajv) G Si 
to the state ( 61 ,..., & /v) defined by 

bk = 0 if a*, = 1 and either k = N or ak +1 = • • • = a» = 0; bj = a,j for j k, 

that is, the last 1 in the iV-tuple (ai,..., ajv) changes to 0. These rules define the 
edges of the graph P. Fig. [3] (right) shows T for N = 4. 


7 




















f(.x) 



Figure 4: Function /) : R —>• R (left) 
fi{x 1 ) + xl (right). 


Xl 



4 Proofs 

4.1 Proof of Theorem 12.11 

Realization of the system for u = it* will be a smooth functional 

V(x, it*) = fi(x i) + xl, x = (xi,x 2 ) £ K 2 , 

which has local minimum points x™ = (x™, 0 ),..., xjf. = (x ™., 0 ), where x™ < 
• • • < x%. are the local minima of the scalar function fi : R —> R; W is a number 
of vertices in the set S); and, fi(x i) = y\ for sufhciently large |xi|, see Fig. [4] We 
require for convenience that fi(x = • • • = /i(x™.) = m* as well as fiixf 1 ) = • • • = 
i) = M* > m * f° r the local maximum points of /,; that separate its local 
minima (although this is not necessary for the following construction), see Fig. [4] 
For the intermediate value rt l+1 / 2 = (m + zq+i)/2, let us define the func¬ 
tional V(-,u l+1 / 2 ) in a similar fashion so that it would have Ni + iVi+i mini¬ 
mum points. That is, V(-,u l+ll/2 ) = f i+ i/ 2 (xi) + x\ where /i+i/ 2 (x™) = ••• = 
fi+i/2{xNi) = /i+i/ 2 ^f) = • • • = f i+ i/ 2 (x™. +1 ) = m* at the local minimum points 
and / i+ i/ 2 (xf) = • • • = f i+ i/ 2 (xj^) = f i+ i/ 2 (xf) = • • • = f i+ i/ 2 (£jv i+ 1 -i) = 
at the local maximum points of f i+ 1/ 2 as well as /i+i/ 2 (xi) = xf for sufficiently 
large |xi|. 

The main step of the proof is the following lemma. 

Lemma 4.1 Suppose that a smooth functional Vo{x) = Vo(xi,x 2 ) = f(x i) + x 2 
has N isolated local minimum points and f(x i) = x 2 for sufficiently large |xi|. 
Let (j i,..., j'jv) be a permutation of numbers (1,..., N). Then there is a smooth 
deformation V(-,u), u G [u_,zz+], such that 

V(;U.) = V(;U+) = V { b(-) 

and the functional V(-,u) has N isolated local minimum points x*(u) for each u £ 
[u_,u_l_]. Moreover, the continuous functions x*(u) : [u-,u+\ —>• R 2 satisfy 

x U u ~) = x j k ( u +)’ k = l,...,N. 

A constructive proof of this statement is presented in the next section. 

We will say that the deformation defined in Lemma 14.11 permutes the minimum 
points. Indeed, for every k, the minimum point x£(u_) of V (•, zz_) and the minimum 
point x* k (u + ) of V(-,u+) are reversibly connected. 
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Assume that a smooth function / : R —>• K that has N local minimum points 
x™ separated by N — 1 local maximum points x^f, 
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and grows at infinity as in Lemma T4. II Assume that a smooth function / : R. —> 
has N — 1 local minimum points x™ separated by points of local maximum xjf , 
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and grows at infinity in the same way. Consider a smooth deformation f{-,u), 
u £ [it_,u + ], with /(-,u_) = /(•), /(•,«_)_) = /(•) such that the maximum point 
xf_i and the minimum point x™ collide and disappear in the saddle node bifurca¬ 
tion for some usn £ (u_, u+), while the other extremum points continue from it_ to 
u+, see Fig- [U That is, /(•, u) has 2N — 1 critical points for u £ [u-,usn) and 2N—3 
critical points for u € {usn, «+], each critical point x™ = x™(u), xf = xf (it) is iso¬ 
lated, and they satisfy relations for u £ [u-,usn), relations (O for u £ {usn, u+] 
and the relation x^_ 1 {usn) = x^}{usn) at the bifurcation point u = usn • Fur¬ 
thermore, all the critical points x™(u),xf (u),..., xf_ 2 (u), x^_ 1 (u) continuously 
depend on u on the interval [u_,u_|_] and the critical points xf_ 1 (u), x^{u) con¬ 
tinuously depend on u in their domain [it_,itsjv]. We will say that a deformation 
satisfying these conditions connects the local minimum x^ = x^(it_) of / to the 
local minimum x^_ 1 = x™_ ± {u + ) of /. Without loss of generality, we will impose 
an extra condition dV/du{-,u-) = dV/du{-,u+) = 0. Such deformations can be 
easily constructed explicitly. 

The above deformation f{-,u) induces the homotopy 

V{x, u) = f{xi,u) + x 2 , x = (xi,x 2 ) eK 2 , u £ [u-, u*], 

that connects the local minimum point x* N {u-) = (x^(u_), 0) of the functional 
V{-,u-) to the local minimum x* N _ x {u-) = (x^_ 1 (u + ), 0) of the functional V{-, u+). 
Every other local minimum x k {u-) = (x™(u_), 0) of F(-,u_) is reversibly con¬ 
nected with the local minimum x* k {u + ) = (x™(it+), 0) of V{-,u + ) {k = 1,... ,N — 2) 
along this deformation. 

A deformation V{-,u), u £ [u_,u+], will be called a concatenation of defor¬ 
mations Vk(-,u), u £ [v k ,v k+1 ] if V{-,u) = Vk{-,u ) for u £ [v k ,v k+1 ], where 
U- = v° < v 1 < ■ • ■ < v K ~ 1 < v K = it_|_ is a partition of the interval [it_, it+]. 

We now define the function V{-, •) for x £ R 2 , u £ [it 1 , u l+1 ] as a concatenation of 
deformations V{-,u) that permute minima and deformations that eliminate minima 
via a saddle-node bifurcation. Assume that the set Si of the graph T has N vertices 
Sfc and the set Sj+i has N' vertices s' k . Using the construction described above, 
we define the functionals V{-,u l ), V{-,u l+1 ), U(-,iT +1 / 2 ) with N, N' and N + N 1 
minimum points, respectively. Now, consider an arbitrary partition of the segment 
[iT +1 / 2 ,id +1 ] into 2N + 1 intervals, iT +1 / 2 = Vq < v\ < ••• < V 2 N +1 = iT +1 , 
and a partition of the segment [u l , u l+1 ^ 2 } into 2N' + 1 intervals, u l = W 2 N'+i < 
■■■< wi < wo = u l+1 / 2 . Let us associate a local minimum x* k of the functional 
V (•, it 1 ) with a vertex Sk £ Si of T (as one-one correspondence), each minimum x** 
of V{-,u l+1 ) with a vertex s' £ Si+i, and each minimum x\ of U(-,id +1 / 2 ) with 
one point of Si U Si+i. Next, let us associate the point v^k, k = 1,..., N, with 
the edge Sfcs'- fe of T that originates at the vertex Sk £ Si and the points W 2 k with 
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the edge s' k se k where s' k G S i+1 . Consider a deformation u G [vo,^i], that 

permutes the local minima and connects the minimum x\ of V(-,vq) associated 
with the vertex Si with the largest local minimum of (with respect to the 

ordering defined by the aq-coordinate of the minimum) and the minimum x^ N+ ^ 
of V(-,vo) associated with the vertex s' n with the second largest local minimum 
of U(-,rq). Then consider a deformation V(-,u), u G [vi,V 2 ], that eliminates the 
largest minimum of V{-,V\) via the saddle-node bifurcation. A concatenation of 
these two deformations reversibly connects the minimum point x^ N+ ^ of C(-,uo) 
associated with s'^ with the largest minimum point of V(-,V 2 ) as well as connects 
the minimum point of U(-,i>o) associated with si to the same largest minimum 
point of V(-, U 2 ). Thus, this concatenation realizes the transition sis^ as u changes 
from vo = u l+l / 2 to V 2 - Furthermore, every other minimum of C(-,t>o) is reversibly 
connected with one and only one minimum of V'(-, i^)- The total number of minima 
of V(-,V 2 ) is JV + N' — 1, one less than U(-,uo) has. 

Now, we proceed by induction to extend the deformation from an interval 
['Co,'C 2 fc— 2 ] to the interval [vo,V 2 k]- The functional V{-,V 2 k- 2 ) has a minimum x\ 
reversibly connected with the minimum x k of U(-,?;o), which is associated with 
the vertex Sk■ Also, V(-,V 2 k- 2 ) has a minimum x^ N+ - k reversibly connected with 

the minimum x' N+ ^ k of V(-,vo), which is associated with the vertex s' fc (recall 
that V 2 k is associated with the edge of T). We use a deformation V(-,u), 

u G [^ 2 fc— 2 j V 2 k-i], that permutes the minima and connects the minimum points x\ 
and Xpf+j of V(-, V 2 k- 2 ) with the largest minimum and the second largest minimum 
of the functional V(-,V 2 k- 1 ), respectively. We further use a deformation V(-,u), 
u G [v 2 k-ii v 2 k] that eliminates the largest minimum. A concatenation of these de¬ 
formations with the deformation defined on the interval vo < u < V 2 k -2 completes 
the definition of V on the interval vq < u < V 2 k -2 and the inductive step. After N 
steps, we obtain the deformation defined for u G [i>o, V 2 . 1 v]- Finally, on the last inter¬ 
val V 2 N <u< V 2 N +1 = we can use any deformation V(-,u) that permutes N' 
local minima z\, ... , z* N , of V(-, V 2 n) and reversibly connects a local minimum x k * 
of V(-,V 2 n+i) with those (unique) local minimum z* of V(-,V 2 n) that is reversibly 
connected with the minimum x^ N+k of U(-,vo) (for every k = 1,..., N'). Now, 
the concatenation of this deformation with the deformation V{-,u), u G [vo,V 2 at], 
realizes all the edges Sks' 1k of T for the input increasing from u l+1 ^ 2 to u l+1 and, 
simultaneously, establishes the reversible connection between the minimum points 
®jv+fc and x k* V(-,u l+1 / 2 ) and V(-,u l+1 ), respectively, for each k = 1,... ,N’. 

Using the same construction, we define a deformation V(-,-) on the interval 
[w\w l+1 / 2 ] that realizes all the edges s' k si k of T with s' k G St + 1 , S 4 G Si for the 
input decreasing from it l+1 / 2 to u l and, simultaneously, establishes the reversible 
connection between the minimum points a?j and x* of U(-,id +1 / 2 ) and 
respectively, for each j = 1,... ,7V. By construction, the concatenation of the two 
deformations V(-,-) defined on the intervals [u 1 ,u l+l ^ 2 ] and [n* +1 / 2 , id +1 ] realizes 
all the edges Sfcs'- fe with Sk G Si, s' fc G Si+i and all the edges s' k st k with s' k G Sj+i, 
st k G Si of the graph T. Finally, the concatenation of such deformations defined on 
all the intervals \u l ,u l+1 ] realizes the whole graph T. This completes the proof of 
Theorem 12.11 


10 



Figure 5: Function / and points < r_ < r® < rl < x™ < xf 1 < x^_ 1 < r+ < 
r+ < r + < xf +1 - 


4.2 Proof of Lemma 14.11 


Suppose that the functional Vo (a;) = f{x i)+x% has exactly N local minimum points 
x* = (X™, 0),..., x = (a;™, 0). Here the isolated local minimum points x™ of the 
scalar function / are separated by the isolated local maximum points 

*5" < xf < x% < • ■ • < x%_ x < x% 

and we assume that /(a;™) = • • • = f(x^) = to* < M* = /( x^ 1 ) = ■ ■ ■ = f(x^_ 1 ). 
It suffices to prove the lemma for a permutation that interchanges the points x* 
and Xj _|_i because any permutation can be obtained as a finite sequence of such 
“elementary” permutations and therefore a realization of any permutation can be 
obtained as a concatenation of the realizations of the “elementary” permutations 
each interchanging two neighboring minimum points. 

Starting with the functional V(x,u-) = Vo (a:) we will concatenate several de¬ 
formations to obtain the functional V(x,u+) = V(x,u-) with x* (u + ) = x* + 1 (u-), 
x* j+ 1 (u+) = x*j(u-) and x*(u+) = x*{u-) for i / j,j + 1 . 

First, define a smooth function f(x i) such that / and / have the same extremum 
points x^.xf 1 -, the maximum value of / at the point xj 1 satisfies /(x^ 1 ) < M* 
where M* is the value of / at all its maximum points; there are points r_,r+ 
satisfying x^_ ± < r_ < xj 1 < xy < xj ^_ 1 < r+ < x^ +l such that f(x i) = f{x i) for 
X\ < r_ and Xi > r + (we agree that Xq 1 , x^ are the non-critical points at which 
/ equals M*) and /(r_) > /(xj 1 ), f(r + ) > /(x^ 1 ); and, there are two intervals 
[ r D, r d] c ( 'r_,x™) and [r+,r+] C (x^j_ 1 ,r+) such that rl — and 


f(r_ + s) = f(r + - s), s £ [0, r_ — r 
f(r 1) > f{xf ), 

see Fig. [5j Without loss of generality we can assume that 


,D i 


K~< I 




= K-*fl 




(4) 

(5) 
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The first deformation we use is the linear deformation 


V{x x ,x 2 ,u) = (1 - a(u))f(x i) + a(u)f(x i) + x\, u€ [u_,v 1 ], 

with v 1 < u + , where a(u_) = 0, a(u 1 ) = 1 and v : ) = 0 (the latter 

condition will be used to smoothly concatenate this deformation with the next one). 
Next, we introduce two more points such that 




< r- < r? < rl < r°_ < xT < x 


M 


< Xj+i < n 


<rl <r. 


D 


< r+ < xf +1 . 


Let us define two concentric circles 8 Dl and dDs with the center (x^, 0 ) and the 
radii (r+ — r {?)/2 = xy — r°_ = r+ — x 1 ^ 1 and (r+ — rl )/2 = x-j 1 — rl = r+ — x ™, 
respectively; a narrow ellipse dE$ elongated along the 2i-axis that intersects this 
axis at the points (r±, 0 ); and a narrow ellipse 8 El elongated along the 22-axis that 
intersects the 21-axis at the points (r±,0). We denote by E$ the closed domain 
bounded by the smaller ellipse, by El the closed domain bounded by the larger 
ellipse, and by Dl and Ds the discs bounded by the circles 8 Dl and dDs, see 
Fig. [ 6 ] (left). That is, Es C Ds C Dl C El- By construction, the domain 
Es contains the critical points (x" L , 0 ), (xj 1 , 0 ), (2™j_ 1 ,0) of the functional F(-,u 1 ), 
while all the other critical points of this functional lie outside El- Let us denote 
by J the segment J = {x = (21, 0 ) : r_ <21 < r+} and define the functional $ by 
the formulas 


$(21,22) = V(2i, 22,2 1 ) for x = (21,2 2 ) G (R 2 \ E l ) U Es U J, ( 6 ) 

$(21,22) = V (xf + y/(2i - xf ) 2 + x\, 0 , u 1 ) for x = (21,22) G Dl \ D s ( 7 ) 

(the latter formula is consistent with (pi))) in the union of the ellipse Es, the annulus 
Dl\ Ds, the segment J and outside the ellipse El- We extend this functional to 
the rest of the plane (21,22) along vertical segments as follows. For every vertical 
segment (of positive length) that belongs either to the upper half-plane 22 > 0 or 
the lower half-plane 22 < 0 and that has one end (2®, 22) on the circle dDs and the 
other end (2^22) either on the curve dEs or the interval {(21,0) : r d _ < x\ < r°_ } 
or the interval {(21, 0 ) : r° < 21 < r + }, the functional is defined by 


$(21,22) 


\A - (rl) 2 l 

l(*i) 2 - (4) 2 I 


$( 21 , x{) + 


V\ - ( 4) 2 

l(^i) 2 -(4) 2 i 


$( 21 , 2 ^). 


( 8 ) 


The same formula defines $ on every vertical segment that belongs either to the 
upper half-plane 22 > 0 or the lower half-plane 22 < 0 and that has one end (xf, 22) 
on the curve 8 El and the other end (21,22) either on the circle 8 Dl or the interval 
{(21,0) : r_ < 21 < rp 5 } or the interval {(21,0) : < 21 < r+}. By construction, 

the continuous and piecewise smooth functional $ satisfies $(21, —22) = $(21,22). 
Furthermore, we assume that the ellipse Ds has a sufficiently short vertical semi¬ 
axis bs', then relation (JSJ) implies that $(21,22) is increasing in 22 in the domain 
{(21,22) : 22 > 0 } fl (Ds \ Es)- We also assume that the ellipse D L has a suffi¬ 
ciently long vertical semi-axis so that $(21,22) is increasing in 22 in the domain 
{(21,22) : 21 € r+],22 > 0 } fl (El \ Dl)- Since the functional V(x±,X2,v 1 ) 

increases in 22 in the upper half-plane and © holds, we conclude that $(21,22) 
increases in 22 in the whole upper half-plane 22 > 0 too. 
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Figure 6: Left: The functionals V(-,v l ) and $(•) coincide inside the ellipse Eg, 
outside the ellipse El and on the segment J. The level lines of the functional 
$(•) inside the annulus Dl\ Ds are concentric circles with the center at the point 
Therefore deformation (TUf!) is continuous. Right: Zoom of the segment 
Jh and its subdivision into small segments by the lines 8 EL,dDL,dDs,dEs and 
X2 = r®, x 2 = r° . 


Now we smoothen $ using averaging over a small disc of radius 
define 

®{xux 2 ) = JJ ®(xi+t.i,x 2 +(;2)d£, 1 d{,2- 

??-Ki<p 2 

This is a smooth functional with the derivatives defined by 
9$ 1 /' 

-^—{x 1 ,x 2 ) = —j r +£ 1,^2 + 6)d£ 2 , (10) 

ox 1 np z J 

??+«f=p 2 

d$ 1 /' 

{x 1 ,x 2 ) = - 2 f ®( x i+ti , x 2 + &)d£ l ( 11 ) 

ox 2 np z J 

Zl+Zl Hp 2 

(with the integrals along the circle taken counterclockwise). Since $ is an even 
functional with respect to x 2 , so is $, that is $(xi, — x 2 ) = $(x\,x 2 ). Therefore, 

for x 2 = 0. (12) 


for x 2 > 0. (13) 

Indeed, if the circle of radius p centered at the point {x\,x 2 ) belongs to the upper 
half-plane x 2 > 0, then relation m follows from m because the functional $ 
strictly increases in x 2 in this half-plane. If part of the circle lies in the lower half¬ 
plane, then (flail follows from the same equality due to the fact that the functional 
$ strictly increases in x 2 and satisfies $(xi, —x 2 ) = ^{xi,x 2 )- 

Relations ©, m imply that all the critical points of the functional $ belong to 
the line x 2 = 0 and are defined by the equation = 0. Note that by construction 


Let us show that 


5$ 

dx 2 

d<& 

dx 2 


= 0 


> 0 


p, that is we 


(9) 
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$ = $ in some neighborhood fl of the critical points of the functional $. Let us 
choose a sufficiently small parameter p of smoothening in ([9]) so that the closed 
disc of radius p centered at every critical point belongs to and p < r® — r+. 
Now, we prove that $ and $ have the same critical points. It suffices to show that 
J^-(aq, 0 ) ^ 0 on the intervals [r_,r°] and [r° ,r + ] (as on the rest of the aq axis 
$ = d>). To this end, let us take a h G [0, p] and consider the horizontal segment 
Jh = {(x\,X 2 ) : r_— p < x i < r°_ +p, aq = h}. We are going to show that $ strictly 
decreases in aq along this segment and therefore equality (flOl) (together with the 
relation $(aq,—aq) = $(aq,aq)) implies that Jjp-(aq, 0 ) < 0 for aq € [r_,r°]. 

Consider the intersections Ji, J 2 , J 3 , J 4 , J 5 of the interval Jh with the sets 
B. 2 \El, El\Dl , Dl\Ds , Ds\Es and Es , respectively (see Fig- El)- On the intervals 
Ji and J 5 , the functional $ decreases with the increasing x\ because ■!> = V(-, v 1 ) = 
f(x 1 ) + h 2 and f'(x 1 ) < 0 in a neighborhood of the interval [r_,r°]. On the inter¬ 
val J 3 , according to 0, we have 4>(aq ,h) = V(xf + {x\ — xf ) 2 + /i 2 , 0, w 1 ) = 

/( xj 1 + ^/(aq — Xj 1 ) 2 + h 2 ), which also implies < 0. It remains to consider the 
segments J 2 and J 4 . The segment J 2 can be divided into two parts, 

J 2 = { {xi , h) : xf - a L ^J 1 - h 2 /b 2 L < aq < r?}, 

J 2 = {{xi,h) : r° < X! < xf - yjR 2 L -h 2 }, 

where (aq — xj 1 ) 2 /a\ + x\/b\ = 1 is the equation of the ellipse 8 El and (aq — 
xf) 2 + a ?2 = Rl is the equation of the circle 8 Dl (see Fig. 0 . According to ©, 
on the interval j|, 

h 2 h 2 (f{ Xl ) + 6 |(l-a)" 2 (aq -xf) 2 )) 

(1 - « Z 2 (aq - xf) 2 ) ) nXl)+ 6 2 (1 - a^ 2 (aq - xf) 2 ) 

hence $(aq, /i) = f(x 1 ) + h 2 and J(^-(aq ,h) = f(x 1 ) < 0 on j|. On the interval J£, 

${xi,h) = (1 - c(xi)) f{xf - R l ) + c(x i)(/(aq) + b 2 L (l -a)) 2 (aq - xf) 2 )) 
with 

, , _ _ h 2 - (R 2 l - (xx-xf) 2 ) _ 

C 3:1 b 2 L (l - a^ 2 (aq - xf) 2 ) - {R\ - (aq - xf) 2 ) ’ 

hence 

Wl = c ' i x i) (f ( x i) + & 1(1 — a~[ 2 {xi — xf ) 2 ) — f(xf — Rl)) 

+ c(aq)(/'(aq)- 2 (aq-ar^)&la£ 2 ). 

Here 

sgnc'(aq) = sgn [{b 2 L {\ - a~f[x 1 - xf) 2 ) - {R 2 L - (aq - xf) 2 ))(xi - xf) 

+ ( a Z 2& ! - !)(®i ^ xf)(h 2 - (R 2 l - (aq - xf) 2 ))} = -1 

because 3> 1; and, c(xi) = 0(h 2 ). Therefore, < 0 for small h. The segment 
J 4 can be divided into two parts, 

J 4 = {(aq, h) : xf - f' R 2 S - h 2 < aq < }, 


®{xi,h) = 1 - 


b l 
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J\ = {(xi,h) : r°_ < xi < xf - a S \Jl - h 2 b s 2 }, 

where (aq — xf) 2 dg + x^bg 2 = 1 is the equation of the ellipse dEs and (aq — 
xf) 2 + x 2 = Rg is the equation of the circle dDs . On the interval Jf, 


$(aq, /i) = I 1 — 


h 2 


Rg - (Xl - xf) 2 


f(x l)+ 


h 2 

__ f(x M - Ra) 

?2 _ („. _ „M\2 J 


R 2 g-{X 1 - X f) 


and therefore, 


<9$ / 


K 2 


R 2 S - {xi - xf) 2 


otffxi - X M ) 

~ nXl)+ (R 2 - ( gl - x M ) 2 ) 2 (f«- R s)-f(xi)), 


hence the relationships f(xf —Rs) > f{x 1 ) and f'{x 1 ) < 0 imply -jff < 0. Finally, 
on the segment , 

®(xi,h) = c(x i)(/(aq) + b 2 s ( 1 - ag 2 {x i - xf) 2 )) + (1 - c(xi))f{xf - R s ) 
with 

R 2 g-{ Xl -xf) 2 -h 2 

C[Xl) R 2 - (aq xf) 2 - 62(1 - a-g 2 { Xl xf) 2 ) ’ 

hence 

UrOi ,h) = c'(x 1 )(f(x 1 )+b 2 s {l-ag 2 (x 1 -xf) 2 )-f{xf - R s )) 

+ c(xi)(f'(xi) - 2(aq - xf)b 2 s ag 2 ). 

Since bs 1, f'(x i) < 0 and f{xf — Rs) > f{x i), the term c(aq)(/'(aq) — 2(aq — 
xf)bg a g 2 ) in this expression is negative and the term (/(aq)+&|(l — af(xi — xf) 2 )— 
f(xf — Rs)) is positive. Furthermore, 

sgnc'(aq) = sgn[-(R 2 s - (xi - xf) 2 -b 2 s {l - ag 2 (xx - xf) 2 ))(x! - xf) 

- (R 2 l - {xi -xf) 2 -h 2 ){b 2 s af - l)(aq - xf )] = 1, 

where we again use bs <C 1. Hence, < 0 on this interval too. 

We conclude that <f> decreases along each segment Jh, \h\ < p. and hence 
J^-(aq,0) < 0 for aq G [r_,r°]. Similarly, one can show that $ strictly increases 
along each segment {(aq,aq) : r+ — p < aq < r + + p, aq = h} and therefore 
J^-(aq,0) > 0 for x\ G [r° ,r+]. Thus, the critical points of $ coincide with the 
critical points of <f>. 

Now, we fix v 2 G (v ,u_|_) and define the linear deformation 

V(x,u) = V(aq ,X 2 ,u) = (1 - a(u))V(xi,X 2 ,v 1 ) + a(u)d>(aq, aq), u G [v 1 ,v 2 ], 

where a(v 1 ) = 0, d(v 2 ) = 1 and |^( v 1 ) = f^{v 2 ) = 0. Since both functionals 
H(aq,aq,tr) = f{x i) + x\ and $(aq,aq) are even in aq, strictly increase in X 2 
for positive aq, have the same critical points and the same monotonicity on the 
intervals of the line aq = 0 separated by the critical points, this deformation also 
has the same critical points for every u G [u 1 , v 2 ]. By construction (see formula (0), 
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each circle (xi — xj I ) 2 + x\ = R 2 within the annulus Dl\ Ds is a level line of the 
functional $ and since the smoothening parameter p has been chosen small enough, 
there is an annulus 1Z = {(xi,x 2 ) : R\ < {x\ — xf 1 ) 2 + x 2 < R 2 } C Dl \ Ds such 
that each circle (x\ — xj 1 ) 2 + x\ = R 2 is a level line of the functional <h. Now, we 
can define a deformation that interchanges the local minimum points xj 1 = (xj*,0) 
and x ™ +1 = (x^_ 1; 0 ) simply using the rotation: 

Tr , . f V(xi cosck — since, x\ sin a + x 2 cosck, v 2 ), (xi — xf 1 ) 2 + x\ < R, 

r(x„®,«) = | v{n X2iV 2 h (x 1 -xj<r + 4>R 

(14) 

with a smooth function a = a(u) defined for u G [n 2 ,x 3 ] C [v 2 ,u+), where R G 
and a(u 2 ) = 0, a(v 3 ) = n, > 0 for u G (v 2 ,v 3 ) and ^(v 2 ) = 

v 3 ) = 0. By construction, the functional V(-,v 3 ) increases in X 2 in the upper 
half-plane and is even in X 2 - Finally, we use the linear deformation 

V(xi,x 2 ,u) = (1 - b(u))V(xi,x 2 ,v 3 ) + b{u){f{xi) +x 2 ), u G [u 3 ,u+], 

with b{v 3 ) = 0, b(u+) = 1 to connect the functional V(-,v 3 ) to the functional 
V(-,u+) = V(-,u-). This completes the proof of the lemma and the theorem. 


Appendix 

Here we briefly discuss multi-scale systems that may lead to equation m in the 
adiabatic limit. Consider a two-dimensional system 

x + 72 c + S7 x V{x 1 u) = 0 

with x = (xi, x 2 ) G M 2 where the potential V depends on a scalar parameter u. We 
assume large friction, 7 > 1. Introducing the slow time r = 7 ^ 1 t, this equation 
can be rewritten as a slow-fast system 

x' = y 

ey' = -\7 x V(x,u)-y 

with a small parameter e = y -2 <C 1 (dot stands for d/dt, prime denotes the 
derivative d/dr with respect to the slow time). This system has an attracting 
slow manifold which approaches the critical surface y = —’S7 x V(x : u) in the limit 
s —y 0 (equivalently, 7 —> 00 ). Hence, for large 7 , dynamics on this manifold can be 
approximated by the gradient equation 

x' = -V x V{x,u) (15) 

or, 7 X = —\/ x V(x 7 u) using the original time t. 

Now, we assume that the parameter u can vary in time slowly, that is u = u(yt). 
Hence, we have a system with three time scales, 

x + 7 X + S7 x V(x 7 u{yt)) = 0, (16) 

and the approximating system with two time scales: 

x' =-V x V(x,u(iit)) (17) 
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where /i = 71 /. The variable u can be interpreted as input of these systems. Finally, 
assume that the characteristic time scale associated with the input variations, 6 = 
vt, is the slowest time scale and, furthermore, p = 'yis <C 1. In this case, dynamics of 
system C3 (as well as dynamics of system m in the limit 7 —> 00 , p = 71 / —> 0 ) 
on the slowest time scale of the input variations, 6 = 1 st, can be described as 
a sequence of transitions between local minimum points of the potential energy 
V(-,u) along the gradient flow of system (fl5l) . We remark that hysteresis is a 
cause of energy dissipation. Namely, each transition from a critical point x*(it) to 
a critical point x*(u) of the potential V(-,u) (induced by a saddle-node bifurcation 
that eliminates the critical point x*(u)) is associated with irreversible dissipation of 
V{x*{u),u) — V(x*(u),u) units of energy. Continuous evolution of the system with 
a minimum point x*(u) of the potential is reversible and dissipationless. 
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